DOCUMENT RESUME 



ED 218 324 



TM 820 364 



AUTHOR, . 
TITLE 

PUB DATE 
NOTE 



EDRS PRICE 
DESCRIPTORS 



McLean, James E. , < 

A Research Based Method by Which a State or Regional 
Association May Select Its Outstanding Paper. 
Mar 82 * 

21p.; Paper presented, at, .the Annual Meeting of the 
American Educational Research. Association (66th, New , 
York, NY, March 19-23, 1982). , / 

MF01/PC01 Plus ^Postage 1 . 1 

Awards; *Competitiye Selection; *Conference Papers; 
♦Evaluation Methods; Professional Association^; 
Regional ^Programs; Research Reports; Writing 
Evaluation 



ABSTRACT • * \ * 

Presented is a research base'd method by which a. state 
of regional professional organization may select the outstanding 
paper from those submitted for consideration. The procedure is 
conducted in three steps: submission, initial review, and final 
selection* During the initial, review process the selection committee 
(four or more members) reviews, all of the papers submitted* They are 
Previewed and rated on aji instrument used' by Ward, Hall, and Schramm 
in 1975 in a study of published educational, research. The .resulting" 
rankings ate used to identify the top five papers. The final 
selection require* , that 10 qualified judges from, outside the state .ot 
region be idfjj^tif ied. Each paper is paired with every other paper. 
The readers compare the two papers in one of the 10 pairs. Standard 
pair 'comparison procedures' are then used* to determine the best paper 
from among those submitted. This method has* resulted in the 
successful selection of the outstanding paper in the -Mid-South* 
Educational' Research Association for tfce past 4 yeairs. (Author/PN) • 
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ABSTRACT 



The purpose of 'this paper is to^ "present a .method by which a state 



or regional pro^esSiori&l organization ma^select the outstanding paper ^ 
'£xom^ thase sj$Uiitt;6d''f or consideration* * # Th^ method has, the advantages 
of "bexttg research :based 4 and semiring outside reader^ to review only twp 
'papers each., The' pjrocedure/is CQridudte'd in three steps. Step 2 results 
in ;the # identification'^ the top ftt/e papers* wt>ich were submitted^ in * 
Step 1.' Ste*p.3 is the selection of the most dutstandifig paper from.- 
amtong these 1 f ive. ^ 1 * ' « 

During^the second step^ the initial review process, the selectic>n 
committee Xwitjv.f our or more members) .reviews all of the papers 

submitted. They are reviewed and rated on an instrument used by 

v * \ , * ' . | . * 

Ward, 1 . Hall, and Schramm in 1975 in a study of published educational 

research- The resulting rankings are used to identify the tap* five 

papers. » 

' Step 3 requires that 10 qualified judges from outside the stat'e^ 
or region be identified* Each pap^r is^paired with every other 
paper. The 10 readers are asked to compare the two papers in one 
of the 10. pairs. Standard pair comparison procedures are then used 
to determine the "best" paper from * among ^those submitted.^ 

This .method resulted in ' the successful selection of the 
outstanding paper in the' Mid-Sou^h Educational Research Association 
for the past 4 years. y . . * 



A RESEARCH BASED METHOD BY WJICH 'A STATE OR REGIONAL 



* ^ASSOCIATION MAY SELECT ITS OUTSTANDING PAPER. 

^ , - - f 

*" V' ' - ' . " / • * > 

The -selection of an out standing papgr ±s .a process- tha; cfen enhance 

the, jQaag^ of c an, association or cause lirf^ter^ing,' problems. It is easily 

seen how th&, Selection of a strong- research papermay enhance the 

image'of ah entire association. - The selection of a poor one may do 

just .the opposite/ Fu£thermore\ a bia'sed .selection' procedure can 

.alienate members of*- the association as well^as result in the selection 

of an inferior paper. . M > * « » 

• The purpose of this paper 'is to 'present', a method by which a state 
or regional' prof essiopal association can^select its outstanding paper . 
from among those submitted for consideration. The* method has the 
advantages Qf being research^ based and requires, outside readers to 
review only two papers eac£. Jhe selection procedure consists of three 
steps— submission, initial review, and final selection* -\ 

Paper Submission ■ * 

• The timely announcement of a winner at* an annual, meeting requires 

* r. 

that papers be submitted 'prior to that time. The entire process should 
» * "* " 

require about six months (Appendix' A) while *t he selection process^ 

conibmes about half of that time* * ' " 

*c>^ The announcement ^of^ the coMetlt'ipn should include all pertinent 

information (Appendix B) . AJ>asic minimum of information wbuld include 



an announcement of the competition, submission requirements (e.g., 
six copies of entire paper.), deadline, and where to submit. Other " 
information' such as a description of the selectiorf process and the 
benefits of winning alsc> could be included. Acknowledgments should 
be sent as each paper is received ('Appendix C) . - 

Requiring members to submit their papers for the competition 
# in a£d it don w to •their regular submission for paper presentation has 



several advantages. 3 The first 



is the high degree of self selection 



that takes place* The 4 aut hor s\\r e o f t en their own),harshest 
critics. Thu^ papers wifc'h major flaws seldom get submitted in 

the^#£st place. A second advantage is that self selection greatly . 

\ 

reduces the number of papers which must be judged. The reduced 
number of papers facilitates the initial^ review process. 

Initial Review Process 
THe initial review process reduces the number of papers under 
consideration to five. The process for accomplishing this review 
depends on the number of papers .which have been submitted. A rule 
of thumb is that no member of the committee should review more 
than about 10 papers.' Thus, if more than 10 papers' were" spotted, ' 
committee members would rea<J only a subset of the papers,. In order 
to reduce Bias, each paper should be read and ranked by at least 
three readers. This may requir^e the size of the committee be * 
increased. - „ *'* " > * 

Each committee member should read and rank (1 = best, 2 ^-second 
"best, etc'.) the .papers assigned to him or her. An r instrunfent^ • - 



used by Ward, Hall, and Sfchramm (197 5)' in a study of published 
research cairbe used for this purple (Appendix D) . % 

The committee 'chairperson collects the rankings and averages 
them for ~each paper. The five papers with the highest average 
rankings (lowest point values) 'become the five* finalists, ,The process 
described above should insure that the best paper is at least among 
tke finalists. . % ' 

Final Selection 

\ 

The selection, of -the outstanding .-paper from anjong the -finalists 
is dpne .by readers 0 £ rom outside the state or region.- Past experience 
has indicated that professionals of the quality desired for this 
tas^are\^ot likely to agree to evaluate five papers. A solution to 
this problenN^s- to use a" pair comparison procedure (Nujinally, 1978). 
The advantage of the pair comparison proc^dujre, is that it requires 
eacb reader to evaluate only two papers. The, disadvantage of the 
procedure is that it requires'10 readers for five papers. 



Selection'of Readers . 



It is best to; select ;readers from o'utside the state or region y 

who* are experience^ educational researchers. The members of /the 

selection .committee can be of great assistance in identifying potential' 

■ « 

readers*, Namfes of potential readers should be solicited from 

committee members (Appendix E) . - r # 

Potential readers shotU^ -be contacted in advanc|. Telephone contacts^ 
are the most efjfieient since $ome of the people named *by the committee 
■will not be willing or abl<* to serve. When 10 readers have ^ 



agreed to serve the other names should be kept as alternates'. 

»• , « 

Review Process • 

Pairing the five papers with each of the other four papers 
v results in 10 pairs of papers, these pairs are randomly assigned 
among the 10- readers, fhe papers are then sent .to the readers with 

^ 4 

appropriate instructions (Appendix F) . The wprk of the' rater 

-should be acknowledged when the papers are returned (Appendix G). 

There are several ways to compare the papers when the readers, ' 

have returned their \fratings. The most straight forward t$ to 
.compete the papers directly. If one paper is judged .best against. 
* each -d£ .£ts four competitors,' then it i-s judged .the "Outstanding 

Paper*" 'As an example, consider the d&ta in Table 1. > 

* * Table 1 ' 1 
Pair Comparison Table 
Paper 



v 



A B C , D £ 



A - A C * A E 

^ J ' - 

B . . - C B E 

Paper C • - C ' C 

D D- 



Ndte that Paper C was" judged best against each of the four other 
papers. Thus, Pfper C would be judged the "Outstanding Paper/ 1 

In certain .situations, there will be no clearcut winner using 
this procedure. Two papers may each be judged best against' only thre§ 
of th£ other ftmr papers. In these situations, the tie must Jbe 
broken. Two possible methods are available for breaking the tie. 
The most straight forward method would % be to declare the winner 
based on the head-to-head comparison. That is, if Papers B and C 
were tied, the winner would be the one which was judged best when 
Paper B was compared directly with Paper C. Another method to 
break the tie would be to go back to, the actual ratings of the 
judges on the research rating instrument. The total ratings given 
by each judge could be averaged and the winner would be the paper 
with the highest average. ' 

Conclusion 

A method for selecting the outstanding paper of a state or 
regional organization is described in this paper." It is research +\ 
based, yet still manageable in a §l?ort period of time. The method 
has been used successfully for the past, 4 years by the Mid-Sou^th 
^Educational Research Association. 
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m . APPENDIX A 

TIME LINE 
FOR SELECTION OF OUTSTANDING PAPER 
(IN WEEKS) * • 



'Activity* • , Begin End' 



Competition announcement \ — . '' \ s 

Submission period ^ n * 1 12 

Initial review. ' * 12 „ 18 

Secure outside reviewers t " 12 . 18 

Selection of finalists " 18 ' . 19 

Filial 'review * 19 « * 23 
* ' * * 

Final selection . - ' 23 , 24 



APPENDIX B 
MS ERA OUTSTANDING PAPER "CDHFETITJON 



--.4- ,,v 



Any mejnber of the Mi'd-South Educational Research Association who submits an 
abstract for a proposed paper to be presented at the annual convention may enter 
.the competition for the Outstanding Paper Award. The award recipient will bkve, 
v a summary of the paper published in the Mid-South Educational Researcher and thie 
opportunity to present it at the AERA Annual Mee t ing in April, The Outstanding 
• t Paper Will be selected according to the following procedures: ' ^ 

^ • . • 

1 . MSERA membets who desire .to participate in the competition must . v 
" * prepare *and submit* six cfopies of .their jr^search papers (no length 

designated) to the chair of t^he selection 'Comnjit tee, Dr. James E. McLean, 
by August 1, 19$U (NQTE: This submission is in addition to the 
abstract of thel&per that must be submitted t o the .Program Committee 
by August 1st ttf be considered* f or the ann ua ] program.) * 

l. A By ; September 1st, members of the selection committee' will review the 
. papers to identify the 5-8 most outstanding papers among those sub- 
mitted. A^. panel of impartial professional people from. outside the 
MSERA region will evMjmte^these papers and submit their results to 
the selection committee.* - * 

~ 3. The results, o£ the panel* sr^ evaluation of the papers will be reported 
, # # » to the*M$ERA Boaxd which will pke the final decision i on the award , 
recipient. >kt the annua] convention /'the Board will Announce the 
threia highest rated papers in" -order of" rank.. * - f 

Members who desire to place fyeir* papers in competition for, the. award and 
the opporttinity to represent MSERA at the 19& AERA Annual Meeting are requested 
to send six copies* of their research papers to: 4 N 



DEADLINE: August 1, 1981 



Dr. James E. McLean- 

P. 0. Box 400$. . 

The University of Alabama 

University, AL 35486 



\ APPENDIX C 

MID-SOUTH EDUCATIONAL f|ESEARCH ASSOCIATION 




P. O. Box 4006' 
University, AL 35486 



August 4, 1981 



NAME 
ADDRESS 
CITY, STATE' 

. Dear 



• Thank you for submitting your paper to be considered ^or the 
MSERA Outstatyiing Paper^Comgetition. As you may know, th6 results 
will be announced at thfe Annual Meeting in e Lexington, Kentupky, ia^ 
November.* In the meantime, please rest assured thatt your papier 
will receive every consideration. 

Thaifk you again for^ considering MSERS Annual Meeting as, a,- 
means of disseminating yotfr research. 



Sincerely,- 



James. E. Mclean t 

Vice President and Chairperson 

Outstanding Paper Selection Committee 

JEM:AW i 
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APPENDIX D 
RESEARCH RATING INSTRUMENT 



The attached research rating instrument was adopted from one used by 
Ward, Hall/ and Schramm (1975) in a study of published research in education. 
Each characteristic is rated on a five-point scale representing five levels 
of quality. • 



Rating 



Level of Quality 



Description 



5 
4 
•3 
2 
1 



Excellent 
Good 

Mediocre $ 
.Poor > 
Completely incompetent 



< * 
A model of good practice 

A few minor defects » 

Not good, not bad 

Some serious defects 

A horrible example 



Please rate each characteristic using the above five-point scale by circling 
the* appropriate response. Use the combined results to rank the papers. 



Most 



Least 



1. _ 

2. _ 

3. _ 

4. _ 

5. _ 

6. _ 

7. _ 

8. _ 

9. _ 
1.0.* 



J 
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Ward, A. W., Hall, B. W., and Schramm, C. F. Evaluation of Published Educational 
Research: A National^ Survey, American Educational Research Journal . Spring,, 
1975, Vol.- 12, No. 2, pp. 109-128. ^ 



APPENDIX* D CONTINUED . 11 ' 

- • RESEARCH RATING INSTRUMENT 
Chacteristic - * . ~ Rating + 



(3) .Hypotheses are clearly stated 

(4) Problem is si^iificant 1 * ^ „ 

(5) Assumptions are clearly stated * 

•; (6) Limitations of the study, are stated e 
v (7) Important terms are defined ' 

♦ •* 

C, Review of the literature s # 

Hf8) Coverage of the literature is adequate 
(9) Review of the literature is well organized 
t (1Q) Studies are examined critically 

(11) Source of important findings is noted 

(12) Relationship of the pro hi em tp previous research 
is made clear 



G. Form and Style 

(31) Report is clearly written 

(32) Report is logically organized 



scientific attitude 

ERIC . V, 



1 2 3 .-4 • 5 



A. Title 

(1) Title is^well related to content of article 

B. Problem \?. * f " : '. v • 

(2) Problem .is clearly stated " y. 1 „ 2 3 * ^ 



1 2 3 4 5 
1 2 3 4 5 
12 3-45 
1 .2/ 3 4 : 
1 2, 3 4 5 



1 2 3 4 5 

1 2 3 4 ; 5 

12 3 4 5 

1 2 3 4 5 

1 2 3 4 .5 

1-2 3 4 5 



D. Procedures * 

(13) Research design is described fully 

(14) * Research design is appropriate to solution of ^* 

the .problem . 5 * 7 5 

(15) 'Research design is free of specif ic weaknesses ' .1 2 3 4 5 

(16) Population and sample are described 12 3 4 5 

(17) Method 4ff sampling is appropriate 

(18) Data gathering methods or procedures are described 4 

(19) Data gathering methods or procedures are 
appropriate to the solution of the problem 

(20) Data gathering methods or procedures are used correctly 

(21) Validity and reliability of data gathering 
procedures are established ( 



1 2 3 4 5 

1 2 3 4 5 

1 2 -3* 4 5 

1 2 3 ,4 5 



1 2 3 4 5 
1 2 3 • 4 5 



; Data Analysis 

(22) Appropriate methods are selected to analyze data 

(23) Methods utilized in analyzing the'^data are 
applied correctly 

(24) Results of the analysis are presented clearly 

(25) Tables and figures are effectively used ^ 

. Summary and Conclusions 

(26) Conclusions are clearly stated 

(27) Conclusions are substantiated by the evidence presented 

(28J Conclusions are relevant to the problem 1 J *3 4 5 

(29) Conclusions are significant 

(30) Generalizations are confined to the population from 
which the sample was drawn • ... 



12 3 4 5 
1-2 3 4 5 



1 2 3 4. 5 
1 2 3 4 5 



1 2 3 4 5 

f 

1*2 3 4 5 



1 2 3 4 5 
1 2 3 4 5 



(33) Tone of the report displays an unbiased,' impartial, 



1 2 3 4 .5 



15. 



Aiaeama 
Arkansas 

K«ntucKV 
Louisiana 

Mississippi 
T«nn#ss«« 



MID-SOUTH EDUCATIONAL RESEARCH ASSOCIATION v 




P. 0. Box 4009 . 
University, AL 35486 



June 15, 1981 



/ 



NAME ^ 
ADDRESS » 
CITY, STATE 

Dear 



I am pleased that you* have agreed to serve, on the^MSERA 
Outstanding Paper Selection Cdmmittee. In order to familiarize you 
with the process we hatfe been using for' the past. three years, I am 
enclosing a copy of^ the committee procedures as approved by the 
MSERA BoardL of Dirfectots. ' 1 

' * Mds£ o*f our work comes between August 1 and November !• At 
this time, I would appreciate you suggesting the names of .five 
possible paper judges from outside the MSSRA region. These people 
would have*to read, rate, and rank only two papers since we use a 
pair comparison technique. Please send me their names/ addresses, 
and'jihohe numbers. We will be contacting them about the first of 
September. 

* 

If we -get more than five entries, we, as a committee, will 
have to read them and* choose the top five. 

I loo£ forward to working with you on this mast' important 
committee. - 

Sincerely, t 



James E. McLean. 

Vice President and Chairperson^ 

Outstanding Taper Selection Committee 

JEM:AW 

Enclosure • * , *' 



Ataoama 

Arkansas 

KtntucKy 

touisiana 

Mississippi 



' AP?EMPIK F 

^ID-SOUTH EDUCATIONAL RESEARCH ASSOCIATION 



13 




• O.-Box 4006 
University, AL 35486 



September 17 ,1981 , 



NAME 
ADDRESS 
CITY, STATE 

Dear 



My sincer est. appreciation is expressed for your wOJfingness to 
assist in selecting the Outstanding Paper for the 1981 ^hnu^l -Meet ing 
of the* Mid-South Educational Research "Association^ X t 



M*p: 



s, two rating 
lease rate each 
tal letter in 
instrument/ 



Enclosed you will find copils of two resear 
instruments. with instructions, and a return env£ 
paper on the appropriate instrument identified by a 
black magic marker in the upper right hand corner o 
Return the completed rating instruments po me in th4^ej>£losed envelope. 
-Feel free to make any additional comments that might Ve helpful to the^ 
selection committee. You may discard the papers after completion of 
the rating instruments. 

In order to meet the deadlines put on the committee, it would be , 
helpful if you could return the rating instruments to me by 
October 16,, 1981. " " 

Thanks very much for your contribution to MSERA and our profession, 

Sincerely, 



James E. McLean 

Vice' President and Chairperson 
Outstanding Paper Selection Coimnittee 
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APPENDIX F CONTINUED ' 

3 

RESEARCH RATING INSTRUMENT 



The attached research rating instrument was adopped- f rom one u*»d by- 

•Tard7?aU, and Schramm (1975) In a study of published research £ education. 

Zach characteristic is rated on a five r .point scale representing five levels 
of quality. 



lating 



5 
4 
3 ' 
2 
1 



Level oflQuality 



Excellent 
Good 

Mediocre 
Poor 

Completely incompetent" 



Description 



A model of good practice 
A few minor defects. 
Not .good,; not bad 
Some serious defects 
A horrible example 



Please rate each characteristic using the above' five-pointy scale by circling 
the aviate refuse. In the space below, indicate which of the two papers . 
was better based on your overall judgment. A ^ ^ 



Better paper 



„ 'A a tj" Hall «b W and Schramm, C. P. Evaluation of Published Educational 
r d n A h "T^n, i 5^5! S S Educational Search Journal. Springy 
1975, Vol. -12, No. 2,- pp. 1&9-128. 



r 



APPENDIX F CONTINUED 1 , 
RESEARCH RATING INSTRUMENT 



Chacterlstic 



A. Title 

(1) Title is well, related to content of ^article 

B. Problem v ' ~ 

(2) Problem is clearly -stated 

(3) Hypotheses are clearly , stated 

(4) Ptoblem is significant ■ * ' ' . 

(5) Assumptions are clearly stated / 
. (6) Limitations of the study are stated 

(7) Important terms are defined^ 

C. Review of the literature 

, (8) Coverage of the literature is adequate 
(9) Review of the literature is well organized , 

(10) Studies are examined critically- 

(11) - Source of important findings is noted 

(12) Relationship of thejjroblem to previous research 
is made clear 

» 

D. Procedures 

(13) Research design is described fully 

(14) Research design is appropriate to solution of 

the problem c , 

(15) Research design is free $f specific weaknesses 

(16) JPopylation mk sample are described * e * 

(17) Method of sampling is appropriate ^ 

(18) Data gathering methods or procedures are' described / 

(19) Data gathering methods or procedures are 
appropriate to the solution of the problem 

(20) Data gathering methods or procedures are used correctly 

(21) Validity and reliability of data gathering 
procedures are established^ V 



ER?C 



E. Data Analysis 

(22). 



N , Appropriate methods are selected to analyze data 

(23) iiethods utilized in analyzing the ' data are " 
• applied correctly „ 

(24) -Results of the- analysis are presented clearly 

(25) Tables. and, figures, are effectively used 



P. 



(26) 
*(27) 
(28) 



Summary and Conclusions , 
Conclusions are clearly stated 

Conclusions are substantiated' by the evidence presented 
Conclusions are relevant to the problem . 
(29) Conclusions*"are significant ^ 
• (30) Generalizations are confined to the population from ■ 
which the sample was drawn' 

G. Pcma and Style 

(31) Report is clearly written 

(32) Report is logically„.orgariized 

(33) Tone of the^eport displays an unbiased, impartial, 
-scientific; attitude % ' 



1 
1 
1 
1 
1 
1 



1 
1 



1 
1 
1 
1 
1 
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Rating 



1 2 3 4 5. 



2 
2 
2 
2 
2 
2 



1 '2 
1 2 



2 

2 




3 
3 
3 
3 
3 
3 



3 
3 
3 
3 



A 
A 
A 
A 

A. 
A 



A 
A 
A 
A 



5 

: 5 
5- 
5 
5 
5' 



5 
5 



2 
2 
2 
2 
2 



3 
3 
3 
3 
3 



A 
A 
A 
A 
A 



1 2 3 A 5 



1 2 3 4, 5 



5 
5 
5 



1 2 3 4 5 
1 2 3 A' 5 

1 2 3 A- 5 



1 2 3 A 




"1 


2 3 


A 


5* 


1 


2 3 


A 


5 


1 


2 3 


A 


5 


1 


2 3 


A 


5 


1 




A 


•5 


1 


Ifi 


A 


5. 




h 






1 




A 


' 5 










T 










2f,3 


A 


. 5 


c 


,2><\ 3 


A 


5 




2 3 


A 


5 



AP.PENDIX F CONTINUED' ^ 16 

RESEARCH RATING IHSTRU14EHT " 
C^acteriitic - ^ting + 



A. Title ""A * ' ' * m • 

(1) Title is well -related to content of article . 12 3 4 



B. Problem- * ' " / 

(2) Problem is clearly stated . 12 3 4 5 

(3) Hypotheses are clearly stated . 1 2 3 * ^ 

(4) Problem is significant ° 1 \ 3 4 5 

(5) Assumptions are clearly stated 1 2 3 4 | 

(6) Limitations of the study are stated > 1, 2 -3 4 5 

(7) Important terms' are defined l.*2 3 4 5 



Review of the literature 

(8) Coverage of the literature is adequate 

(9) Review of the literature is well, organized , 

(10) Studies are examined critically t ( 

(11) Source^of important findings is noted- 1 2 3 4 d 

(12) Relationship of the problem to previous Research 
" is made clear * 



12 3 4 5^ 
12 3-45 
1 2 3 4 5 



^ Procedures 

(13) Research design is described fully v 
^(14) Research design, is appropriate to solution of -» 

the problem >• 
(15) Research design is free of specific weaknesses 



1 2 3 4 5 
f 2 3 4 5 



1 2 3 4 5 

_^ _ m 1 2 3 4 5 

1 (16) Population and samrile are described 12 3 4 5 

(17) Methbd of sampling is appropriate 

(18) Data, gathering methods or procedures are described 

(19) Data gathering ^ethods or procedures are 
appropriate to the solution of the' problem 

(20) Data gathering methods or procedures are used correctly* 

(21) Validity and reliability of data gathering . % , • 
procedures are established ,12 3 4 5 



1 2 3 4 5 
1 2 3 4 5* 

12,345 
1 2 3 4 5 



1 2 3 4 5 



■E. Data Analysis , 

(22) Appropriate methods arp selected to analyze data 

(23) Methods utilized in analyzing t;he data are 
applied 'correctly , 

(24) Results of the gfiitelysis are presented clearly, . . 1 2 3 4 5 

(25) Tables, and figures ^are .effectively used 

F. Summary and Conclusions • . - # 

(26) Conclusions are f clearly staffed * / 

(27) Conclusions are substantiated by the evidence presented . v 1 2 3 4 5 

(28) Conclusions are relevant to tU problem 1 2 3 4 5 

(29) Conclusions are signiHcant* . * 1 2 3 4 5 
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P. 0. Box.Af>06 
University, Alabama 35436 



October 16, '1981 



NAME* • 
ADDRESS * . 
CITY, STATE 

Dear 



On behalf of the Mid T South Educational* Research Association, 
I express my .sincereat "appreciation for the- fine- job you did in 
evaluating the .papiers in <W 1981 "Outstanding Paper 11 competition. 
>t/ 1 t regi;et th^Jf in order" to maintain the anonymity of the process, 
the association cannot givk mor£ visible recognition .to reviewers,- 
such as yourself, irr the Proceedings °of the Association. 

Please accept; my thanks personally and 1^ behalf of MSERA 3 for 
your valuable contribution^to the Association «and'our profession. 

' ; Sincerely, • , * 



JEM: AW 



James E . McLean 

Vice-President qpd Chairperson 
Outstanding Paper Selection Committee 



